Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

Cultivating emotional intelligence in general surgery residents through a patient-centered experience.

BACKGROUND: Emotional intelligence (EI) can decrease physician burnout. EI and burnout were assessed in surgical residents through participation in Patient-Centric Resident Conferences (PCRCs), which incorporated patients in resident education. We hypothesized PCRCs would improve EI and reduce burnout. METHODS: This was a single institution study of General Surgery residents from 2018 to 2019. Residents participated in standard didactic conferences and PCRCs. The Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF) survey and an ACGME burnout survey were administered at three time points. RESULTS: Higher EI scores correlated with lower burnout scores over three survey distributions (R2 0.35, 0.39, and 0.68, respectively). EI and burnout scores did not change significantly over time. EI and burnout were not associated with conference attendance, meaning in work, or satisfaction with teaching. CONCLUSIONS: General Surgery resident EI and burnout scores were inversely correlated. Previously, PCRCs were shown to be associated with increased resident meaning in work. The current study demonstrates PCRCs did not have a significant impact on measures of resident EI or burnout. Further research is needed for EI and burnout in surgery.

An Executive Summary of the National Trauma Research Action Plan (NTRAP).

ABSTRACT: The National Trauma Research Action Plan (NTRAP) project successfully engaged multidisciplinary experts to define opportunities to advance trauma research and has fulfilled the recommendations related to trauma research from the National Academies of Sciences, Engineering and Medicine (NASEM) report. These panels identified more than 4,800 gaps in our knowledge regarding injury prevention and the optimal care of injured patients and laid out a priority framework and tools to support researchers to advance this field. Trauma research funding agencies and researchers can use this executive summary and supporting manuscripts to strategically address and close the highest priority research gaps. Given that this is the most significant public health threat facing our children, young adults, and military service personnel, we must do better in prioritizing these research projects for funding and providing grant support to advance this work. Through the Coalition for National Trauma Research (CNTR), the trauma community is committed to a coordinated, collaborative approach to address these critical knowledge gaps and ultimately reduce the burden of morbidity and mortality faced by our patients.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

Faculty Entrustment and Resident Entrustability.

Importance: As the surgical education paradigm transitions to entrustable professional activities, a better understanding of the factors associated with resident entrustability are needed. Previous work has demonstrated intraoperative faculty entrustment to be associated with resident entrustability. However, larger studies are needed to understand if this association is present across various surgical training programs. Objective: To assess intraoperative faculty-resident behaviors and determine if faculty entrustment is associated with resident entrustability across 4 university-based surgical training programs. Design, Setting, and Participants: This cross-sectional study was conducted at 4 university-based surgical training programs from October 2018 to May 2022. OpTrust, a validated tool designed to assess both intraoperative faculty entrustment and resident entrustability behaviors independently, was used to assess faculty-resident interactions. A total of 94 faculty and 129 residents were observed. Purposeful sampling was used to create variation in type of operation performed, case difficulty, faculty-resident pairings, faculty experience, and resident training level. Main Outcomes and Measures: Observed resident entrustability scores (scale 1-4, with 4 indicating full entrustability) were compared with reported measures (faculty level, case difficulty, resident postgraduate year [PGY], resident gender, observation month) and observed faculty entrustment scores (scale 1-4, with 4 indicating full entrustment). Path analysis was used to explore direct and indirect effects of the predictors. Associations between resident entrustability and faculty entrustment scores were assessed by pairwise Pearson correlation coefficients. Results: A total of 338 cases were observed. Cases observed were evenly distributed by faculty experience (1-5 years' experience: 67 [20.9%]; 6-14 years' experience: 186 [58%]; ≥15 years' experience: 67 [20.9%]), resident PGY (PGY 1: 28 [8%]; PGY 2: 74 [22%]; PGY 3: 64 [19%]; PGY 4: 40 [12%]; PGY 5: 97 [29%]; ≥PGY 6: 36 [11%]), and resident gender (female: 183 [54%]; male: 154 [46%]). At the univariate level, PGY (mean [SD] resident entrustability score range, 1.44 [0.46] for PGY 1 to 3.24 [0.65] for PGY 6; F = 38.92; P < .001) and faculty entrustment (2.55 [0.86]; R2 = 0.94; P < .001) were significantly associated with resident entrustablity. Path analysis demonstrated that faculty entrustment was associated with resident entrustability and that the association of PGY with resident entrustability was mediated by faculty entrustment at all 4 institutions. Conclusions and Relevance: Faculty entrustment remained associated with resident entrustability across various surgical training programs. These findings suggest that efforts to develop faculty entrustment behaviors may enhance intraoperative teaching and resident progression by promoting resident entrustability.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Pediatric emergency resuscitative thoracotomy: A Western Trauma Association, Pediatric Trauma Society, and Eastern Association for the Surgery of Trauma collaborative critical decisions algorithm.

LEVEL OF EVIDENCE: Literature synthesis and expert opinion, Level V.

Integrating Surgical Palliative Care Into the Full Spectrum of Medical Education.

We describe our institutional approach to incorporating surgical palliative care education into the Undergraduate Medical Education, Graduate Medical Education and Continuing Medical Education spaces as a model to help guide similarly interested educators. We had a well-established Ethics and Professionalism Curriculum, but an educational needs assessment revealed that both the residents and faculty felt that additional training in palliative care principles was crucial. We describe our full spectrum palliative care curriculum, which begins with the medical students on their surgical clerkship and continues with a 4 week surgical palliative care rotation for categorical general surgery PGY-1 residents, as well as a Mastering Tough Conversations course over several months at the end of the first year. Surgical Critical Care rotations, Intensive Care Unit debriefs after major complications, deaths, and other high-stress events are described, as is the CME domain, which includes routine Department of Surgery Death Rounds and a focus on palliative care concepts in Departmental Morbidity and Mortality conference. The Peer Support program and Surgical Palliative Care Journal Club round out our current educational endeavor. We describe our plans to create a full spectrum surgical palliative care curriculum that is fully integrated with the 5 clinical years of surgical residency, and include our proposed educational goals and year-specific objectives. The development of a Surgical Palliative Care Service is also described.

How well do we understand our patients' perioperative experience? A qualitative analysis of themes derived from patient-centric resident conferences.

BACKGROUND: Patient-centric resident conferences (PCRCs) provide meaningful time to connect with and learn from patients. This qualitative study explores themes of patients' perioperative experiences from PCRCs through patient and resident perspectives. METHODS: General Surgery residents participated in six PCRCs, which include condensed standard didactics to accommodate a patient panel regarding their perioperative experience. Panel transcripts and resident survey responses describing what they learned were coded using grounded theory methodology. Themes were evaluated and compared. RESULTS: 76 identified codes were grouped into major categories: "Medical/Surgical Knowledge," "Patient Perspective," "Patient-Physician Relationship," and "Communication." Themes from resident responses predominantly paralleled patient discussion, with common themes including "impact of disease and surgery on patient" and "compassion/empathy." "Medical/surgical knowledge" was only present in resident responses while themes regarding quality of life were more frequent in patient transcripts. CONCLUSIONS: PCRCs are a valuable tool in resident education to understand patients' perioperative experiences. Themes from patient panels complement, but do not replace, information covered in didactic lectures.

Factors Associated With Provision of Nonbeneficial Surgery: A National Survey of Surgeons.

OBJECTIVE: We tested the association of systems factors with the surgeon's likelihood of offering surgical intervention for older adults with life-limiting acute surgical conditions. BACKGROUND: Use of surgical treatments in the last year of life is frequent. Improved risk prediction and clinician communication are solutions proposed to improve serious illness care, yet systems factors may also drive receipt of nonbeneficial treatment. METHODS: We mailed a national survey to 5200 surgeons randomly selected from the American College of Surgeons database comprised of a clinical vignette describing a seriously ill older adult with an acute surgical condition, which utilized a 2×2 factorial design to assess patient and systems factors on receipt of surgical treatment to surgeons. RESULTS: Two thousand one hundred sixty-one surgeons responded for a weighted response rate of 53%. For an 87-year-old patient with fulminant colitis and advanced dementia or stage IV lung cancer, 40% of surgeons were inclined to offer an operation to remove the patient's colon while 60% were inclined to offer comfort-focused care only. Surgeons were more likely to offer surgery when an operating room was readily available (odds ratio: 4.05, P <0.001) and the family requests "do everything" (odds ratio: 2.18, P <0.001). CONCLUSIONS: Factors outside the surgeon's control contribute to nonbeneficial surgery, consistent with our model of clinical momentum. Further characterization of the systems in which these decisions occur might expose novel strategies to improve serious illness care for older patients and their families.

Blunt pancreatic trauma: A Western Trauma Association critical decisions algorithm.

BACKGROUND: The Western Trauma Association (WTA) has undertaken publication of best practice clinical practice guidelines on multiple trauma topics. These guidelines are based on scientific evidence, case reports, and best practices per expert opinion. Some of the topics covered by this consensus group do not have the ability to have randomized controlled studies completed because of complexity, ethical issues, financial considerations, or scarcity of experience and cases. Blunt pancreatic trauma falls under one of these clinically complex and rare scenarios. This algorithm is the result of an extensive literature review and input from the WTA membership and WTA Algorithm Committee members. METHODS: Multiple evidence-based guideline reviews, case reports, and expert opinion were compiled and reviewed. RESULTS: The algorithm is attached with detailed explanation of each step, supported by data if available. CONCLUSION: Blunt pancreatic trauma is rare and presents many treatment challenges.

Peer-to-Peer Trauma-Informed Training for Surgical Residents Facilitated by Psychiatry Residents.

OBJECTIVE: This article describes the implementation of trauma-informed care (TIC) didactic training, using a novel, interdisciplinary peer-to-peer teaching model to improve confidence surrounding trauma-informed practices in a surgical residency program. METHODS: Eight psychiatry residents and two medical students with a background in psychological trauma and TIC and an interest in medical education were recruited to participate in three 2-hour "train the trainer" sessions led by a national expert in TIC. Eight psychiatry residents and two medical students subsequently developed and delivered the initial TIC training to 29 surgical interns. Training included the neurobiology of psychological trauma, principles of trauma-informed care, and developing trauma-informed curricula. RESULTS: Surgical interns reported significantly improved understanding of the physiology of trauma, knowledge of TIC approaches, and confidence and comfort with TIC and practices. Among surgical interns, understanding of the physiology of the fear response increased from 3.36 to 3.85 (p = 0.03). Knowledge of the neurobiology of trauma improved between pre- and post-training surveys (2.71 to 3.64, p = 0.006). Surgery interns also expressed an improved understanding of the connection between fear, trauma, and aggression (3.08 to 4.23, p = 0.002) from pre- to post-training surveys. Post-training knowledge of trauma-informed approaches increased from 2.57 to 4.71 (p < 0.001) and confidence in delivering TIC on the wards increased from 2.79 to 4.64 (p < 0.001). CONCLUSION: This TIC curriculum delivered via a peer-to-peer training model presents an effective way to improve comfort and confidence surrounding TIC practices and approaches in a surgical residency training program.

What Should the Surgeons Do at the Family Meeting: A Multi-Disciplinary Qualitative Description of Surgeon Participation in Palliative Care Discussions.

OBJECTIVE: National guidelines have suggested that quality surgical care should incorporate effective palliative care (PC). Numerous barriers to surgeon participation remain and the domains of optimal surgeon participation are unclear. DESIGN: Eight semi-structured and multi-professional focus groups with 34 total participants. Discussion was transcribed, and qualitative approaches were used to encode, identify, and categorize emergent themes. SETTING: Oregon Health & Science University, Portland Oregon. A tertiary care teaching hospital. PARTICIPANTS: 34 multi-disciplinary participants in eight focus groups, identified on a volunteer basis. RESULTS: Key themes defining domains of optimal surgeon/palliative practice include: (1) "primary/secondary PC" which detailed conflict between the surgeon's desire to be part of palliative discussions and competing clinical/time demands. (2) "role/responsibility" described the tension surgeons feel around a desire to provide honest and goal concordant care (3) "teamwork/conflict" detailed the approach to disagreement among multidisciplinary teams. CONCLUSIONS: In this qualitative analysis, emergent themes suggest that surgeons want to be involved in the PC of their patients but are limited by available time and competing for ethical obligations. Tension between competing communication and care obligations and PC goals is common, and discord around patient goals remains an issue. This work highlights the need for a standardized curriculum to improve the PC of surgical patients.

Developing a National Trauma Research Action Plan: Results from the postadmission critical care research gap Delphi survey.

INTRODUCTION: The 2016 National Academies of Science, Engineering and Medicine report included a proposal to establish a National Trauma Research Action Plan. In response, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care from prehospital care to rehabilitation as part of an overall strategy to achieve zero preventable deaths and disability after injury. The Postadmission Critical Care Research panel was 1 of 11 panels constituted to develop this research agenda. METHODS: We recruited interdisciplinary experts in surgical critical care and recruited them to identify current gaps in clinical critical care research, generate research questions, and establish the priority of these questions using a consensus-driven Delphi survey approach. The first of four survey rounds asked participants to generate key research questions. On subsequent rounds, we asked survey participants to rank the priority of each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Twenty-five subject matter experts generated 595 questions. By Round 3, 249 questions reached ≥60% consensus. Of these, 22 questions were high, 185 were medium, and 42 were low priority. The clinical states of hypovolemic shock and delirium were most represented in the high-priority questions. Traumatic brain injury was the only specific injury pattern with a high-priority question. CONCLUSION: The National Trauma Research Action Plan critical care research panel identified 22 high-priority research questions, which, if answered, would reduce preventable death and disability after injury. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Developing a National Trauma Research Action Plan: Results from the long-term outcomes research gap Delphi survey.

BACKGROUND: In the National Academies of Sciences, Engineering, and Medicine 2016 report on trauma care, the establishment of a National Trauma Research Action Plan to strengthen and guide future trauma research was recommended. To address this recommendation, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care. We describe the gap analysis and high-priority research questions generated from the National Trauma Research Action Plan panel on long-term outcomes. METHODS: Experts in long-term outcomes were recruited to identify current gaps in long-term trauma outcomes research, generate research questions, and establish the priority for these questions using a consensus-driven, Delphi survey approach from February 2021 to August 2021. Panelists were identified using established Delphi recruitment guidelines to ensure heterogeneity and generalizability including both military and civilian representation. Panelists were encouraged to use a PICO format to generate research questions: Patient/Population, Intervention, Compare/Control, and Outcome model. On subsequent surveys, panelists were asked to prioritize each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Thirty-two subject matter experts generated 482 questions in 17 long-term outcome topic areas. By Round 3 of the Delphi, 359 questions (75%) reached consensus, of which 107 (30%) were determined to be high priority, 252 (70%) medium priority, and 0 (0%) low priority. Substance abuse and pain was the topic area with the highest number of questions. Health services (not including mental health or rehabilitation) (64%), mental health (46%), and geriatric population (43%) were the topic areas with the highest proportion of high-priority questions. CONCLUSION: This Delphi gap analysis of long-term trauma outcomes research identified 107 high-priority research questions that will help guide investigators in future long-term outcomes research. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Pregnancy in trauma-A Western Trauma Association algorithm.

BACKGROUND: The Western Trauma Association has undertaken publication of best practice clinical practice guidelines on multiple trauma topics. These guidelines are based on scientific evidence, case reports, and best practices per expert opinion. Some of the topics covered by this consensus group do not have the ability to have randomized controlled studies completed because of complexity, ethical issues, financial considerations or scarcity of experience. Care of the pregnant trauma patient is one of these clinically complex situations that is based on physiologic data, standard trauma care, trauma care experience, and outcomes. METHODS: Review of multiple evidence- based guidelines, case reports, and expert opinion were compiled and reviewed. RESULTS: The algorithm is attached with detailed explanation of each step, supported by data if available. CONCLUSION: Resuscitative and trauma care of the mother is the utmost priority. STUDY TYPE: Algorithm, expert opinion, consensus. LEVEL OF EVIDENCE: Diagnostic Tests/Criteria; Level III.

Developing and leading a sustainable organization for early career acute care surgeons: Lessons from the inaugural American Association for the Surgery of Trauma Associate Member Council.

ABSTRACT: The associate membership of the American Association for the Surgery of Trauma (AAST) was established in 2019 to create a defined but incorporated entity within the larger AAST for the next generation of acute care surgeons. The Associate Member Council (AMC) was subsequently established in 2020 to provide the new AM with an elected group of leaders who would represent them within the AAST. In its inaugural year, this cohort of junior faculty and surgical trainees had developed for the AM a set of bylaws, a mission statement, a strategic vision, and a succession plan. The experience of the AAST AMC is exemplary of what can be accomplished with collaboration, mentorship, innovation, and tenacity. It has the potential to serve as a template for the creation and vitalization of future professional groups. In this piece, the AMC proposes a blueprint for the successful conception of a new organization.